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DETAILED ACTION 

Response to Amendment 

1 . In response to the Office Action mailed January 28, 2008, applicant submitted an 
amendment filed on April 28, 2008 in which the applicant amended and requested 
reconsideration. 

Response to Arguments 

2. Applicant has amended the independent claims to include the limitations that 
have been indicated allowable. However, after further search and reconsideration, the 
claims have been rejected in view of new grounds of rejection. The Office regrets any 
inconvenience. 



Claim Rejections - 35 USC § 103 

3. The following is a quotation of 35 U.S.C. 1 03(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 



4. Claims 1, 4, 6-21, 24 and 26-42 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Peterson et al. (USPN 6,922,466), hereinafter referenced as 
Peterson in view of Kemp (PGPUB 2002/0169609). 
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Regarding claims 1 and 21, Peterson discloses a speech data mining (mining; 
column 1 9, line 59 - column 20, line 21 and column 40, line 57 - column 41 , line 4) 
system and method, hereinafter referenced as a system for use in generating a rich 
transcription having utility in call center management, comprising: 

a speech differentiation module (speaker change detector; column 20, lines 3-57) 
adapted to receive speech input from the first speaker on a first channel (telephone 
lines), to receive speech input from the second speaker on a second channel, and to 
differentiate between the first speaker and the second speaker (telephone handset; 
column 1 1 , lines 15-43) by identifying speech of the first speaker with speech received 
on the first channel, and identifying speech of the second speaker with speech received 
on the second channel (caller and live agent; column 22, lines 15-25 with column 20, 
lines 42-50); 

a speech recognition module (speech recognizer) improving automatic 
recognition of speech of a second speaker based on interaction of the second speaker 
with a first speaker preferentially employed as a reference speaker (column 20, lines 3- 
57); and 

a transcript generation module (annotations) generating a rich transcript based at 
least in part on recognized speech of the second speaker (column 8, lines 1-6 and 
column 1 9, lines 3-23 with column 34, lines 46-59 and column 40, line 57 - column 41 , 
line 4), but does not specifically teach a system that employs the first speaker as the 
reference speaker based on quality of the first channel being higher than quality of the 
second channel. 
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Kemp teacher a speaker identification method that employs the first speaker as 
the reference speaker based on quality of the first channel being higher than quality of 
the second channel (model quality id better (paragraph 0030), to ensure good 
performance within the identification process. 

Therefore, it would have been obvious to one of ordinary skill in the art at the 
time the invention was made to modify Peterson's method as described, to ensure 
particular high identification rates and a large reliability of the identification result 
(paragraphs 0002-0003), as taught by Kemp. 

Regarding claims 4 and 24, Peterson discloses a data mining system wherein 
said speech recognition module is adapted to employ the first speaker (first speaker) as 
the reference speaker based on availability of a speech model (speaker model) adapted 
to the first speaker (column 20, lines 42-50). 

Regarding claims 6 and 26, Peterson discloses a system wherein said speech 
recognition module is adapted to identify a topic with respect to which the speakers are 
interacting (topic detector), and to employ a focused language model (statistical model) 
to assist in speech recognition based on the topic (column 20, line 42 - column 21 , line 
19). 

Regarding claims 7 and 27, Peterson discloses a system wherein said speech 
recognition module is adapted to receive an explicit topic selection from one of the 
speakers (topic; column 20, line 42 - column 21 , line 1 9). 

Regarding claims 8 and 28, Peterson discloses a system wherein said speech 
recognition module is adapted to prompt a speaker corresponding to a call center 
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customer to explicitly select one of a plurality of predetermined topics by pressing a 
corresponding button of a telephone keypad (touch-tone; column 14, lines 49-66). 

Regarding claims 9 and 29, Peterson discloses a system wherein said speech 
recognition module is adapted to identify a predetermined topic associated with an 
electronic form selected by call center personnel (call center's; column 14, lines 49-66). 

Regarding claims 10 and 30, Peterson discloses a system wherein said speech 
recognition module is adapted to extract at least one keyword from a speech recognition 
result of at least one of the interacting speakers, and to identify a predetermined topic 
based on the keyword (topic detector; column 20, line 42 - column 21, line 10). 

Regarding claims 11 and 31, Peterson discloses a system wherein said speech 
recognition module is adapted to extract context from a speech recognition result of the 
first speaker, and to employ the context extracted from the speech recognition result of 
the first speaker as context in a language model (statistical models) utilized to assist in 
recognizing speech of the second speaker (column 20, line 3 - column 21, line 19). 

Regarding claims 12 and 32, Peterson discloses a system wherein said speech 
recognition module is adapted to extract at least one keyword from a speech recognition 
result of the first speaker (word), and to supplement a constraint list (stock) used in 
recognizing speech of the second speaker based on the keyword extracted from the 
speech recognition result of the first speaker (column 20, line 58 - column 21 , line 1 0). 

Regarding claims 13 and 33, Peterson discloses a system wherein said speech 
recognition module is adapted to extract at least one keyword from a speech recognition 
result of the first speaker (word), and to rescore recognition candidates generated 
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during recognition of speech of the second speaker based on the keyword extracted 
from the speech recognition result of the first speaker (column 20, line 58 - column 21 , 
line 10). 

Regarding claims 14 and 34, Peterson discloses a system wherein said speech 
recognition module is adapted to detect interruption of speech of one speaker by 
speech of another speaker (speaker change detector), and to employ the interruption as 
context in a language model (statistical model) utilized to assist in recognizing speech of 
the second speaker (column 20, line 2 - column 21, line 19). 

Regarding claims 15 and 35, Peterson discloses a system wherein said speech 
recognition module is adapted to detect an interruption of speech of one speaker by 
speech of another speaker (speaker change detector), and to record an instance of the 
interruption as mined speech data (mining; column 20, line 2 - column 21, line 19). 

Regarding claims 16 and 36, Peterson discloses a system wherein said speech 
recognition module is adapted to extract at least one keyword from a speech recognition 
result of at least one of the interacting speakers, to identify a frustration phrase 
associated with the keyword, and to record an instance of the frustration phrase as 
mined speech data (frustration; column 21, lines 10-19). 

Regarding claims 17 and 37, Peterson discloses a system wherein said speech 
recognition module is adapted to extract at least one keyword from a speech recognition 
result of at least one of the interacting speakers, to identify a polity expression 
associated with the keyword (polite), and to record an instance of the polity expression 
as mined speech data (column 21, lines 10-19). 
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Regarding claims 18 and 38, Peterson discloses a system wherein said speech 
recognition module is adapted to extract at least one keyword from a speech recognition 
result of at least one of the interacting speakers, to identify a context corresponding to 
at least one of a topic (topic), complaint, solution, and resolution associated with the 
keyword, and to record an instance of the context as mined speech data (column 21, 
lines 10-19). 

Regarding claims 19 and 39, Peterson discloses a system wherein said speech 
recognition module is adapted to identify a number of interaction turns based on a shift 
in interaction from speaker to speaker (marks speakers turn), and to record the number 
of turns as mined speech data (column 20, lines 3-51). 

Regarding claims 20 and 40, Peterson discloses a system comprising a quality 
management subsystem employing mined speech data as feedback to at least one of a 
call center quality management process and a consumptible quality management 
process (quality; column 1 1 , line 57 - column 1 2, line 42 and column 1 9, line 24 - 
column 20, line 21). 

Regarding claim 41, Peterson discloses a system wherein said speech 
recognition module is adapted to employ an interactive focused language model in 
which yes/no questions relate to context of at least one of preceding or subsequent 
speech of another interacting speaker (was the call resolved; column 19, lines 3-14). 

Regarding claim 42, Peterson discloses a system wherein said speech 
recognition module improves automatic recognition of the speech of the second speaker 
by employing previous and subsequent (tabulating) and recognized words of the 
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speaker in addition to context of previous and subsequent interactions (interaction) with 
the referenced speaker (column 2, line 54 - column 3, line 4). 

5. Claims 5 and 25 are rejected under 35 U.S.C. 1 03(a) as being unpatentable 
over Peterson in view of Kemp and in further view of Liu et al. (PGPUB 2004/0204939), 
hereinafter referenced as Liu. 

Regarding claims 5 and 25, Peterson discloses a data mining system, but does 
not specifically teach a system wherein speech differentiation module is adapted to use 
speech biometric. 

Liu discloses a system and method for speaker change detection comprising: 
use a speech biometric trained on speech of the first speaker to distinguish 
between speech of the first speaker and speech of another speaker (biometrics 
mechanism; paragraph 0041 ), to improve speaker change detection. 

Therefore, it would have been obvious to one of ordinary skill in the art at the 
time the invention was made to modify Peterson's system wherein speech 
differentiation module is adapted to use speech biometric, as taught by Liu, to provide 
fast speaker boundary detection (column 1 , paragraphs 001 0-001 1 ). 

Conclusion 

6. The prior art made of record and not relied upon is considered pertinent to 
applicant's disclosure. 
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• Zhou (PGPUB 2002/01 98707) discloses a psycho-physical state sensitive voice 
dialogue system. 

7. Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to JAKIEDA R. JACKSON whose telephone number is 
(571)272-7619. The examiner can normally be reached on Monday-Friday from 
5:30am-2:00pm. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, David Hudspeth can be reached on 571-272-7843. The fax phone number 
for the organization where this application or proceeding is assigned is 571-273-8300. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a 
USPTO Customer Service Representative or access to the automated information 
system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 

/David R Hudspeth/ 

Supervisory Patent Examiner, Art Unit 2626 

JRJ 

July 25, 2008 



